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Abstract 

This paper describes a method for locating the 
Mars rover using an elevation map generated 
from satellite data. In exploring its environ- 
ment, the rover is assumed to generate a local 
rover-centered elevation map that can be used 
to extract information about the relative posi- 
tion and orientation of landmarks correspond- 
ing to local maxima. These landmarks are in- 
tegrated into a stochastic map which is then 
matched with the satellite map to obtain an 
estimate of the robot’s current location. The 
landmarks are not explicitly represented in the 
satellite map. The results of our matching algo- 
rithm correspond to a probabilistic assessment 
of whether or not the robot is located within 
a given region of the satellite map. By assign- 
ing a probabilistic interpretation to the infor- 
mation stored in the satellite map, we are able 
to provide a precise characterisation of the re- 
sults computed by our matching algorithm. 

1 Introduction 

In the current projections for the Mars Rover project, 
a satellite is placed in Mars orbit prior to the rover’s 
arrival in order to collect stereo images of the Mar- 
tian surface with approximately 1 meter resolution. 
These images are relayed to earth and used to gen- 
erate a high-resolution elevation map of the regions 
that the rover is expected to explore. Once the rover 
has landed on Mars, this elevation map will be used 
to keep track of the position of the rover and plan out 
paths for it to follow in performing its exploration of 
the planet’s surface. As the rover moves about, it will 
use passive-stereo imaging and a laser range finder to 
construct a depth map of its immediate area. This 
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depth map is then converted into an elevation map 
which is merged with the map generated from satel- 
lite data to provide greater detail. 

We will refer to the map generated from satellite 
data simply as the satellite map, and the map gen- 
erated from local observations made by the rover as 
the rover map . In this paper, we describe a technique 
for merging these two maps by using the rover map 
to locate the rover’s position in the satellite map. 
Our method requires that the rover be able to ex- 
tract the location of landmarks from the rover map, 
where a landmark corresponds to a local maximum 
(or peak) in the surrounding terrain. We assume that 
the measurements made by the rover are subject to 
known errors. The relative locations of the land- 
marks with respect to the rover’s current location are 
stored in stochastic map [Smith et a/., 1985] that is 
maintained using the approximate transform method 
of [Smith and Cheeseman, 1986] (see also [Durrant- 
Whyte, 1988]). We describe an algorithm that pro- 
vides an estimate of the rover’s current location in 
terms of a probability assignment to fixed regions in 
the satellite map. For our methods to work, the ter- 
rain must have such locally observable features that 
can be differentiated given the resolution and accu- 
racy of the information stored in the satellite map. 
The work described in this paper represents a spe- 
cific application of a general technique first described 
in [Hayashi and Dean, 1988]. 


2 Problem Definition 


2.1 Satellite Map 

In the satellite map, the area of interest is divided 
into small square regions of the same size referred to 
as sectors. For each sector, the map contains both 
upper {H+) and lower (JjT~) bounds on the elevation 
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Figure 1: Satellite map 



Figure 2: Polar coordinates for vision 

within that sector (see Figure 1). 

H- i%i <Z(X,Y)<H+ i%i 

Xi <Xi+i\Xi = i*d,Xn.i = {i+ l)*d,0<t< N-l 
Yj < r i+ i; Yi = j*d,Yj+ t = (j + l)*d,0<j<N-l 

where Z(X , K) is the actual height at location ( X , T ), 
d is the length of the side of a sector (also referred 
to as the map’s resolution), and there are N 2 sectors. 
H~ij and B+i,j are the only information that the 
satellite map contains. There are no explicitly spec- 
ified landmarks. The origin of the satellite map is 
chosen arbitrarily. 

2.2 The Vision System 

We assume that the rover has a vision system that 
can recognize the peaks of hills. The peaks of hills 
should be the most distinguishable features of a 
scene. We further assume that the vision system 
always succeeds in identifying unoccluded peaks in 
scenes, and that it is capable, with some statistical 
regularity, of identifying a peak as one that it has seen 
before. The vision system iB not perfect, but the rover 
has a good approximation of its errors. The values 
that the vision system returns are the mean (v m ) and 


the standard deviation (<r v ) of the peak’s location in 
the rover-centered polar coordinate system shown in 
Figure 2. 



where r is the distance to the peak, <f> is the azimuth 
angle to the peak in radians, and 9 is the elevation an- 
gle to the peak in radians. Azimuth angle is measured 
anti-clockwise from the East ( e.g. t 0 for East and 
for North), and the elevation angle is measured anti- 
clockwise from the horizontal direction. Obviously, a 
compass and gyro are necessary to make these mea- 
surements possible. We assume that each variable, 
r, <f > , and 0, forms a mutually independent normal 
distribution, i\T(r|r m , o*), N{B\6 m ,<?}). 

The notation iV(s|s m , a*) is used as shorthand for a 
normal distribution of variable x with mean x m and 
variance er£. The mean vector Mv(&t V, z) and the co- 
variance matrix CV(®, y,z) in Cartesian coordinate 
system will become necessary later and are derived 
from those in the polar coordinate system as: 

( *m \ / r m * cos d m * c°s d> m \ 

Vm I = I I'm + cos 6 m * sin # m I 
Zm } \ r m *sin0 m ) 

( 1 ) 

C v (z tV ,z) = R3.Cv(r,4> t 9)*R t 3 (2) 

where 

/ 0 0 \ 

CV(r,^,0)=[ 0 <t\ 0 

\ 0 0 aj ) 


-y m -Zm * COS <t>m \ 

Vm/ J*m ®m ““Zm * 8in (f> m I 

sin0 m 0 r m + cos0 m / 

R$ is the value of J at the mean (pv), where J is 
the Jacobian of the transformation between the two 
coordinate systems. See Figure 3 for a visual charac- 
terization of the mean and covariance. 

In the figures, we use certainty ellipsoids to rep- 
resent the mean vectors and covariance matrices of 
our spatial variables. A certainty ellipsoid is the re- 
gion within which its corresponding spatial variable 
lies given some probability (say 90%). The center of 
the ellipsoid is the mean vector. The relationship be- 
tween a certainty ellipsoid and a covariance matrix is 
explained in [Smith and Cheeseman, 1986]. 
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Figure 3: Returned values from the vision system 


Figure 4: Movement coordinates 


2.3 Rover’s Movement 

The format of the rover’s movement command is a 
pair (dm, a m ) where dm is the horisontal distance to 
a destination (m), and a m is the azimuth angle to a 
destination in radians. 

To consider movement errors, we assume ac- 
tual movement (d, a) is obtained using normal distri- 
butions, iV^dldm,^) and N(a\ct m ,<rl) respectively. 
The meanB of the distributions (dm and a m ) are 
the values specified in the movement command. 
The standard deviations (<7 a and <r a ) are computed 
from the accuracy of movements. The mean vector 
Mm(*» Vi z ) and the covariance matrix Cj*(z, y, z) in 
Cartesian coordinate system are: 



/ C m y 0 \ 

Vl 2 ) = I Cy* Cyy 0 j (4) 

V 0 0 C BM ) 


the current location and the destination, and there- 
fore depend on the terrain along the movement path 
(which is not well known). 

3 Building an Internal Map 

When the rover explores an area, it builds an internal 
map so that it can match the internal map later with 
the satellite map. The internal map that we use is 
based on the stochastic map representation described 
in [Smith et at., 1985]. A stochastic map consists 
of a mean vector and a covariance matrix of spatial 
variables, and gives us estimates of the spatial relar- 
tionships of these variables, their uncertainties, and 
their interdependencies. In addition, it provides us 
with a very elegant way of propagating constraints 
from various observations. 

3.1 Rover’s Internal Map 

The internal map is a stochastic map which con- 
sists of a mean vector (u) and a covariance matrix 
(C(u, u)) of the vector (u) of the spatial variables . 


where 


( 




) 


= R J C(d m ,a m ) R\ 



f Ui > 


f Ul > 


u 2 


u 3 

u = 

: 

u = 

* 


) 


\“n / 


C(dm,a m ) — ( q 

C,M = 


( ®tn/dm “3/m 
2/m l dm x m 


See the illustration in Figure 4. Note that ele- 
vation angle to a destination is not specified in the 
movement command, since the rover can only move 
along the surface of the ground no matter whether it 
is uphill or downhill. Consequently the corresponding 
mean (zm) and the standard deviation (cr,) must be 
computed separately. They represent the expectation 
and the variance of the difference of height between 


) 


c{ u,u) = 


/ C(ui,ui) 
[ C(u 2 ,ui) 


C(ui,u 3 ) 
C(uj, uj) ••• 


V C( Un» Ui) c{ u n> u 2 ) ••• 


where 

Ui = ( Xi.yi.Zi)* 

Ui = E(ui) 

C(Uj,Uj) = £((Ui - Uj) • (u ; - 


C(ui,u n ) > 
C(u 2) u„) 

^(^ni Uri) J 
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Our spatial variables (ui’s) are 

• locations of sensed peaks 

• the rover’s previous locations 3 

• the rover’s current location (ur) 

The coordinate system used is a Cartesian coordinate 
system whose origin is the initial location of the rover 
(ui) and whose y, z axes are parallel to those of a 
satellite map. It is referred to as the global coordinate 
system. 

3.2 Information in the Internal Map 

The estimation of a spatial variable u< (i.e. the esti- 
mation of the ith variable’s coordinates in the global 
coordinate system) is Hi and its uncertainty is ob- 
tained from C(ui, Ui). As a special case, for the ini- 
tial location which was chosen as the origin of the 
global coordinate system, ui = 0, and C(ui,ui) is 
a 0 matrix, since there is no uncertainty of ui with 
respect to itself. The estimation of the Bpatial rela- 
tionship between u,* and u; is Uj — u*, and its inter- 
dependency is obtained from C(uj, u»). 

3.3 Moving 

When the rover makes a movement of from its 
current location ur, new location ur* in the global 
coordinate system is 



Figure 5: Rover movement 



Figure 6: Seeing a new peak 


U R* = Ur + Urr* 

The mean vector and the covariance matrix of urr* 
are 

URR' = Z ) 

Mm(*, V,*) Cm(c»SM) are defined in (3) and (4). 

The rover’s internal map is expanded from 
(u, C(u, u)) to (u', C(u', u')) as follows (also see Fig- 
ure 5): 


Ur* 

u' 

C(URi t UR*) 
C(U, Ur*) 

C(u',u') 


Ur + Urr* 

( l ) (5 » 

C(un, u/i) + C(un fl ., u RRI ) 
C(u, Ufl) 

( C7(u,u) C(u,ur.)‘ \ 6 x 

\ C(u,Ufi-) C(u R i, ur') / ' 


3 In [Smith tt ai, 1985], the stochastic map does not con- 
tain the rover's previous locations. They are not necessay for 
navigation purposes. But the previous locations are useful for 
our matching purpose, since they give us more clues. From the 
view point of matching, there is no difference between peaks 
of hills and the rover’s locations. 


3.4 Seeing a New Peak 

When the rover finds a new peak at ur p from its 
current location ur, then the location of the peak 
ur (in the global coordinate system) is 

UR = UR + URP 

The mean vector and the covariance matrix of urp 
are 

urr = Mv(*>Vt*) 

C^urr, urr) = CV(as, y, z) 

/i V (*,y,*) and Cy(c,y,z) are defined in (1) and 
(2). The rover’s internal map is expanded from 
(u,C(u,u)) to (u'^u'ju')) in the same way as 
moving (see Figure 0). 

3.5 Seeing the Same Peak Again 

When the rover sees a peak from ur and identifies it 
as up which it has seen before, the internal map is 
updated to get a better estimate of the spatial vari- 
ables (Figure 7). In this case, the size of the map does 
not change, since no new spatial variable is added. 
First, we define a sensor model as follows. 

urp* = f(u) + v = Up - ur + v 
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origin 

Figure 7: Seeing the same peak again 


where uap' is the sensor measurement values, defined 
as pv in (1), u is the vector of spatial variables, and 
v is the sensor noise with 0 mean. 

Next, we compute the conditional estimates of 
the above sensor values (ujip»), and their uncertain- 
ties (C(llHP',URP')). 


u rp> = f(u) = F u • u = up - UR 


C(uhp», unp') = Fu ■ C(u ,u J-FJj-I-CJvjv) 



0 1 0-0-10 ••• 0 
up up 


where C(v f v) is defined as Cy in (2). 

Then, we update the map (u",C(u‘,u")) 
to (u + ,C(u + ,u+)) using Kalman Filter equations 
[Smith and Cheeseman, 1986). 


K — C(u“,u“) • Fu • [C(upp',upp ')] _1 

u+ = u” + K • (urp> — upp*) 

C(u + ,u + ) = C(u“, u“) - K - Fu • C(u“,u“) 


Through the above equations we can get better es- 
timates and certainties of not only up and up, but 
also all spatial variables that are correlated with up 
and up. 


4 Matching the Two Maps 

We have described both the satellite map and the 
rover’s internal map. Note that the rover’s internal 
map is built from observations independent of the 
satellite map. In this section we will explain the algo- 
rithm used to match the two maps in order to locate 
the rover with respect to the satellite map. The basic 
idea is the following. If we know the location of any of 
the spatial variables with respect to the satellite map, 
we can transform all spatial constraints between the 
two maps. It is then easy to compare the two maps. 
Since we don’t know (with certainty) the location of 


any spatial variable with respect to the satellite map, 
we attempt to rule out those locations that are im- 
plausible returning the likely locations as an estimate 
of the rover’s location. 

4.1 Sector Assignment 

We start by assuming that the rover is located within 
certain sectors 3 of the satellite map. 

Xi < ®p < Xi+% 

y% < vr < y <+i ( 7 ) 

< Z R < 

where (zjt,yjzi*j0 w the rover’s current location in 
the internal map, (Xi,Yj) is the vertex of (i,j)th 
sector in the satellite map, (Xj+it^j+i) 1* the ver- 
tex of (t 4- 1, j + l)th sector in the satellite map, 
and H~ij f H+i t j are the lower and upper bounds of 
heights in the (i, j)th sector in the satellite map. 

4.2 Assignment as a Sensor Measure- 
ment 

We try to express the assignment (7) as a kind of 
sensor measurement so that we can incorporate it 
into the internal map. From (7) we get 

) Xo - ^»+i ^ Xo — < Xo ~ Xi 

Yo-Yj+x < Yo-Vr <Y 0 - Yj ( 8 ) 

Zo — If + * p j ^ Xo " Z R ^ Xo — H ij 

where (Xo, Y 0 , Zo) » the origin of the satellite map. 

We choose (X 0| Y 0 , Jf~o,o) a* the origin. Note 
that the middle terms in (8) correspond to u*o» the 
relative position of the satellite map’s origin from the 
current location (Figure 8). 

uro = uo — uh (9) 

where uo is the origin of the satellite map in the 
global coordinate system. 

In our model, the vision system is supposed to 
return the mean vector and the covariance matrix 
for a sensed object. In other words, the vision sys- 
tem returns its certainty ellipsoid which corresponds 
to some confidence threshold. Hence we approximate 
the cuboid region (8) with a circumscribed ellipsoid 
(Figure 9), and then convert it to a mean vector and 
a covariance matrix. We can obtain a certainty ellip- 
soid from a covariance matrix [Smith and Cheeseman, 
1986). Here we follow the derivation in the opposite 
direction, and we get 

( 0.0 — (i + 0.5)d 
0.0 — (j + 0.5)d 

-+*+*) *0.6 


5 Sectors Me the square region* that make up satellite map*. 
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(12) 



C(uo,u 0 ) 

Cfu, u 0 ) 

C(u'u') 



C(u R , ur) + C(uro> Uflo) 
C(u, u«) 


( C(u, u) 

V C(u,u 0 ) 


C(u,u 0 )‘ \ 
C(u 0 ,u 0 ) ) 


(13) 


Although we have incorporated only the origin 
of the satellite map, we actually have merged the two 
maps. Via uo, we can transform any constraint in 
the internal map to the constraint in the satellite map 
and vice versa. 


Figure 8 : Assigning the rover a sector 



Figure 9: Circumscribed ellipsoid for u^o 


4.4 Checking Assignment 
Consistency 

The assignment made in (7) is arbitrary. We have 
to check whether it is consistent with both the given 
sastellite map and the rover’s observations. For any 
peak the rover has seen (and also for any previous 
location of the rover), its coordinates in the satellite 
map } s coordinate system are given as 

Up = up - u o (H) 

If the initial assignment (7) is correct, then Up 
should be contained in some CUBOID(k,l) of the 
satellite map, for Up = (ajp, y^Sp)* is the coordi- 
nates of a peak in the satellite map’s coordinate sys- 
tem. For some k and /, we have 


/ 3/4d 2 0 0 \ 

c(u*o,uro)= 0 3 / 4< * J 0 |+*r a (“) 

\ 0 0 3/4 h 2 } 

where d is the resolution of the satellite map, h is 
( 2 f + i t j - and 7 in ( 11 ) is a constant chosen 

for a particular confidence threshold (profc 4 ), and sat- 
isfies the following formula, 

prob = 2 * $( 7 ) - 1 - v/27 w * 7 * 

where $( 7 ) is the cumulative density function of the 
unit normal distribution. 


Xk < ®p < Xk+i 

Yi< rtp <Ti + 1 (15) 

< *p < # + fc,i 

In order to check the inequalities (15), we need 
the actual distribution of Up. We use a certainty 
ellipsoid for that purpose. Given a confidence level 
(pro 6 ), the certainty ellipsoid ELLPS(prob) for Up 
can be computed from its mean and covariance. 
These are obtained from the expanded internal map 
(12) and (13), 


4.3 Merging the Two Maps 

We incorporate uq in (9) (the origin of the satel- 
lite map) into the rover’s internal map as a vir- 
tual landmark. The internal map is expanded from 
(u,C(u, u)) to (u', C(u', u')) as follows, using ( 10 ) 
and ( 11 ). 

Uo = UH + UfiO 


4 The probability that (x, Vr *) falls within the circumscribed 
ellipsoid. As we want the same sised ellipsoid in the next 
step, prod should be the same as the value which is 
used in the checking step. 


Up = Up - Uo 

C(up,up) = C(up,up) + C(uo,uo) — 2 • C(up,uo) 

When we set the confidence level (prob) suffi- 
ciently large, we should expect 

Up € ELLPS(prob) (10) 

From (15) and (16), it follows that for any up in the 
internal map, there is some (k } l) s.t. 

CUBOID(k t l) intersects ELLPS(prob) of u'p. 

(17) 
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■ NM» 

Figure 10: Checking consistency 

Figure 10 illustrates this property. 

To reiterate, statement (17) is only a necessary 
condition for a sector assignment (7) to be correct 6 * 8 . 
It is not a sufficient condition. In general, several 
sector assignments may satisfy (17). The total num- 
ber of assignments which satisfy (17) depends on the 
satellite map’s fuzziness and how many useful obser- 
vations the rover has obtained so far. To find all sec- 
tors which are consistent, we repeat the above assign- 
ment and check steps for every sector in the satellite 
map. 

5 Simulation 

We tested our method using a simulation, and the 
initial results are encouraging. The simulation was 
carried out using a small terrain model to expedite 
the experiments. Realistic terrain data was obtained 
using techniques derived from fractal geometry. We 
assume that the rover has a vision system that can 
sense the peaks of hills. 

The results of matching were weak at first. Too 
many sectors were left as possible locations of the 
rover. This was because sector assignments cor- 
respond to a much bigger certainty ellipsoid than 
those of sensor measurements; even an accurate sen- 
sor measurement became a vague one when it was 
compounded with a sector assignment in the match- 
ing phase. By making the covariance matrix of the 
sector assignment smaller, we were able to obtain sat- 
isfactory narrowing of the possible locations of the 
rover. 

6 Conclusions 

A method has been developed to locate the rover us- 
ing local observations and a global satellite map. The 

6 To be more precise, ifc is not even a necessary condition 

because there is a slight chance that the actual position of a 

peak falls outside of the ellipsoid. 


method provides answere to questions of the form: 
“Ib it consistent to assume that the rover is located 
within a fixed area?” Its theoretical foundations are 
firm in the sense that the matching algorithm checks 
mathematically necessary conditions for a location 
assumption to be correct; the algorithm does not rely 
on any heuristics. 

It should be noted that our problem cannot be 
handled using methods adapted from work on cruise 
missile guidance systems [Kober et a i., 1979]. Since 
cruise missiles are equipped with a highly accurate 
inertial guidance system, there is little uncertainty 
about their positions and orientations. More impor- 
tantly, the missile sensors provide measurements from 
roughly the same perspective used in constructing the 
navigation map (the analog of our satellite map). We 
have also considered the possibility of using template 
matching techniques for our problem [Thorpe, 1981], 
but the low resolution of the satellite map makes 
landmark identification difficult and would appear to 
severely reduce the accuracy of the matching method. 

7 Future Work 

The simulations carried out so far are not sufficient. 
In order to make our method more effective and ro- 
bust: 

• We need guidelines on good threshold values for 
consistency checking. 

• We need a better way of modeling of sector as- 
signments than pseudo-sensor readings. 

• We need to provide some way of tuning our 
method to suit the requirements of particular 
satellite maps and sensors. 

So far, our main concern has been finding the 
current location of the rover with respect to the satel- 
lite map. But our matching method can be applied 
to the rover’s navigation problem as well. Our work 
attacks the same problem as [Levitt ti a/., 1987], 
but with the emphasis on metric rather than qualita- 
tive matching. In navigation problems, global maps 
usually contain some distinctive places (landmarks) 
and the paths are specified in terms of landmarks. 
Being able to determine the current location of the 
rover, identify landmarks, and determine the rover’s 
location relative to a particular landmark are impor- 
tant problems that have to be solved for successful 
path planning and path following. Our matching al- 
gorithm should be useful in solving these problems 
since it can check the consistency of assumptions on 
the location of any of the observed peaks in the global 
(satellite) map, or on the relative location of the rover 
to some landmark. 
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